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(57) Abstract: Media processing in software can be used for consumer terminals like digital television sets or set-top boxes. For 
reasons of cost-effectiveness, the average processor utilization must be high. This is mostly achieved by allocating below worst-case 
processor budgets to tasks performing media processing operations. Only if a stable output quality is a primary requirement, a task 
gets allocated a worst-case processor budget. To gain back on the cost-effectiveness in such a situation, a method and a system are 
provided to reallocate an unused part of a budget (212) from a first task (?m) with a worst-case budget to a second task (?p) with a 
below worst-case budget. The second task (?p) may then use the resulting budget surplus (216) to improve the quality of its output 
The method and system operate at a very low level, in the scheduling of the tasks performing the media processing. What effectively 
happens is that the second task (?p) gets executed in the place of the first task (?m), as if it were the first task (?m), with scheduling 
characteristics such as period and priority of the first task (?m). 
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Method and system for allocating a budget surplus to a task 



The invention relates to a method of scheduling a first task and a second task, 
the method comprising the following steps: 

a first step of allocating a first budget to the first task, 

a second step of allocating a second budget to the second task, 
5 a third step of determining that the first task uses up only part of the first 

budget, with the remaining part of the first budget giving rise to a budget surplus, 

a fourth step of reallocating the budget surplus to the second task, in addition 
to the second budget. 

The invention also relates to a system for scheduling a first task and a second 
10 task, the system comprising: 

first allocation means conceived to allocate a first budget to the first task, 

second allocation means conceived to allocate a second budget to the second 

task, 

determination means conceived to determine that the first task uses up only 
15 part of the first budget, with the remaining part of the first budget giving rise to a budget 
surplus, 

reallocation means conceived to reallocate the budget surplus to the second 
task, in addition to the second budget. 

Media processing in software enables consumer terminals to become open and 
20 flexible. At the same time, consumer terminals are heavily resource-constrained, because of a 
high pressure on costprice. To be able to compete with dedicated hardware solutions, media 
processing in software has to use the available resources very cost-effectively, with a high 
average resource utilization, while preserving typical qualities of consumer terminals, such as 
robustness, and meeting stringent timing requirements imposed by high-quality digital audio 
25 and video processing. An important resource in this respect is the media processor used for 
performing the media processing operations. 

Media processing in software makes it possible to use dynamically scalable 
applications, trading resources for quality. At run-time, a Quality of Service (QoS) resource 
manager can adapt the quality levels at which the applications execute, so as to maximize the 
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perceived quality of the combined application outputs, given the available resources. A 
central concept in the QoS resource management is the notion of a resource budget assigned 
to an application. To address dynamic behavior at different time scales, the QoS resource 
manager is conceived as a multilevel structure. The higher levels determine and adjust quality 
5 levels and resource budgets to maximize perceived output quality. At the lowest level, a 
budget scheduler provides, guarantees and enforces the allocated resource budgets. In the 
case of a processor, this will typically entail an allocation of processor capacity to application 
tasks. Thus, the higher levels of the QoS resource manager build their policies on a 
mechanism provided by a lower level. The adjustment of quality levels and resource budgets 
10 is based on measurements and on feedback control between the QoS resource manager and 
all of the applications concerned. However, because of these interactions, such adjustments 
cannot be done without delay. 

In a situation where a stable quality level is a primary QoS requirement for an 
application, a resource budget allocated to it must be large enough to accommodate an 
1 5 anticipated load increase. In this way, whenever this load increase occurs, it can be 

accommodated without delay. However, in a fully loaded terminal, a higher resource budget 
can only be obtained by giving a smaller budget to other applications. Furthermore, as long 
as the load increase does not occur, a higher resource budget results in a budget surplus, 
reducing the cost-effectiveness. To gain back on the cost-effectiveness, a mechanism is 
20 needed to conditionally reallocate the budget surplus to the other applications. This involves 
modifications at the level of the budget scheduler. 

For the allocation of processor capacity to tasks, the budget scheduler uses a 
scheduling algorithm. This is a set of rules that determine the task to be executed by the 
processor at a particular moment. The budget scheduler uses a scheduling algorithm that 
25 provides the notion of a processor capacity budget, assigned to a task. Budgets are periodic, 
and the budget period may be different for each task. The budget scheduler builds upon a 
more basic scheduling algorithm to provide the notion of a periodic budget. Basic scheduling 
algorithms for an environment such as considered here are described in, for example, Liu and 
Layland, Scheduling Algorithms for Multiprogramming in a Hard Real-Time Environment 
30 (Journal of the Association for Computing Machinery, Volume 20, Number 1, pages 46 to 
61). These scheduling algorithms are pre-emptive and priority driven. This means that, 
whenever there is a request for executing a task that is of a higher priority than the one 
currently being executed, the running task is immediately interrupted and the newly 
requested task is started. Thus, the specification of such algorithms amounts to the 
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specification of the method of assigning priorities to tasks. A scheduling algorithm is said to 
be static if priorities are assigned to tasks once and for all. A static scheduling algorithm is 
also called a fixed priority scheduling algorithm. With respect to achievable processor 
utilization, it can be shown that the rate-monotonic priority assignment is optimal for a fixed 
5 priority assignment rule. A scheduling algorithm is said to be dynamic if priorities of tasks 
might change from request to request. A well-known dynamic scheduling algorithm is the 
deadline driven scheduling algorithm. With this algorithm, priorities are assigned to tasks 
according to the deadlines of their current requests. A scheduling algorithm is said to be a 
mixed scheduling algorithm if the priorities of some of the tasks are fixed and the priorities of 

10 the remaining tasks vary from request to request. Unused processor capacity is often called 
slack time. It results from tasks not completely consuming their budgets, from imperfections 
in the scheduling used, or from unused processor capacity. Improving the cost-effectiveness 
means that the slack time must be minimized. In practice, the presence of some slack time 
will be unavoidable. At a low priority, a task can potentially receive some slack time. This is 

15 called execution in the background. Given that budgets assigned to tasks are generally below 
worst-case to be cost-effective, tasks may have problems in the case of very transient budget 
overloads. A limited amount of slack time may now even be useful to resolve most of these 
overload situations. 



20 

An embodiment of a method and a system of the kind set forth above and as 
defined in the preamble of claim 1 is known from Bril and Steffens, User Focus in Consumer 
Terminals and Conditionally Guaranteed Budgets (Proceedings 9-th International Workshop 
on Quality of Service, Lecture Notes in Computer Science 2092, pages 107 to 120). Here a 

25 budget scheduler is implemented on top of a real-time operating system providing pre- 
emptive priority-based scheduling. The budget scheduler schedules processor capacity and 
provides guaranteed periodic budgets to tasks. This guarantee is based on an admission test 
that checks the feasibility of scheduling a set of budgets, and an enforcement mechanism that 
prevents tasks from interfering with the budgets of other tasks. Budgets are implemented by 

30 means of priority manipulations. In-budget execution is performed at a high priority, and out- 
of-budget execution is done at a low priority. Budgets are periodic, and the budget period 
may be different for each task. For the in-budget execution, the tasks are scheduled in rate- 
monotonic priority order, such that a task with a smaller budget period gets a higher priority. 
This gives rise to a high-priority band for in-budget execution. Priorities of tasks are disjoint 
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in the high-priority band. At the start of each new period, the priority of a task is raised to its 
rate-monotonic priority within the high-priority band. When the budget of a task is 
exhausted, or when the task releases the processor, the priority of the task is lowered to the 
low priority. At the low priority, a task can potentially receive some slack time for execution 
5 in the background. The admission test of the budget scheduler is based on rate monotonic 
analysis. 

For the known method and system, reallocation of a budget surplus from one 
task to another task is done by means of an additional middle-priority band, situated below 
the high-priority band and above the low priority. A task receiving a budget surplus from 

10 another task receives the budget surplus after it has exhausted its own budget. At that instant, 
instead of immediately lowering the priority of the receiving task to the low priority, it is first 
lowered to a priority in the middle-priority band. The budget surplus is now provided at this 
intermediate priority. When the budget surplus is exhausted, or when the task releases the 
processor, the priority of the task is lowered to the low priority. A drawback of this usage of 

1 5 an additional middle-priority band is that it may easily lead to a non-rate monotonic priority 
assignment. In general, such a priority assignment yields a non-optimal solution that conflicts 
with the high average resource utilization aimed for. It may even preclude an effective 
reallocation of the budget surplus altogether. 

20 

It is an object of the invention to provide a method as set forth above that 
reallocates a budget surplus in an improved way. To achieve this object, the method 
according to the invention is characterized in that the fourth step comprises a sub-step of: 

allocating the budget surplus to the second task together with scheduling 
25 characteristics of the first task. 

What effectively happens with this sub-step is that the second task gets 
executed in the place of the first task, as if it were the first task, with scheduling 
characteristics such as period and priority of the first task. The budget surplus expresses the 
processor capacity that was not needed by the first task and that should now become 
30 available to the second task. The scheduling characteristics of a task express the 
characteristics of the task with respect to the scheduling algorithm that is used. 

For the known method and system, the budget scheduler uses fixed priority 
scheduling as the basic scheduling algorithm, with tasks scheduled in rate-monotonic priority 
order. In that case, the scheduling characteristics of a task amount to a budget period and a 
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fixed priority in the high-priority band. Reallocation of the budget surplus together with 
scheduling characteristics now means that a task eligible for a budget surplus receives the 
budget surplus with the period and the priority of the task that gave rise to the surplus. Unlike 
the known reallocation method, the new reallocation method will not affect the rate 

5 monotonic priority assignment used, making possible a more optimal solution, in line with 
the high average resource utilization aimed for. An additional advantage of the new 
reallocation method is that it does not affect the availability of slack time. The known 
reallocation method can potentially consume all the slack time available, leaving no slack 
time for tasks executing in the background. This could affect the behavior of such tasks to the 

1 0 extent that tasks that used to work fine will show problems when the known reallocation 
method is used. This will not happen with the new reallocation method. Another additional 
advantage is that no extra priority levels, due to the need for a middle-priority band, are 
needed with the new reallocation method. Priority levels should be used sparingly, given that, 
in general, operating systems provide only a relatively limited number of them. 

15 For a budget scheduler that uses dynamic priority scheduling with earliest 

deadline first as the basic scheduling algorithm, the scheduling characteristics of a task 
amount to a budget period and a deadline. Reallocation of the budget surplus together with 
scheduling characteristics now means that a task eligible for a budget surplus receives the 
budget surplus with the period and the deadline of the task that gave rise to the surplus. 

20 The system according to the invention is characterized in that the reallocation 

means comprises: 

third allocation means conceived to allocate the budget surplus to the second 
task together with scheduling characteristics of the first task. 

25 

The invention will be described more in detail by means of embodiments 
shown in the following drawings: 

Fig. 1 illustrates an embodiment of the main steps of the method according to 
the invention that reallocates a budget surplus from a first task to a second task, 
30 Fig. 2 illustrates with a task interaction diagram the reallocation of a budget 

surplus, 

Fig. 3 illustrates with a priority level diagram the reallocation of a budget 

surplus, 
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Fig. 4 illustrates, in a schematic way, the most important parts of an 
embodiment of the system according to the invention, 

Fig. 5 illustrates, in a schematic way, the most important parts of a television 
set that comprises an embodiment of the system according to the invention, 
5 Fig. 6 illustrates, in a schematic way, the most important parts of a set-top box 

that comprises an embodiment of the system according to the invention. 

Fig. 1 illustrates an embodiment of the main steps of the method according to 

10 the invention that reallocates a budget surplus from a first task to a second task. For high- 
quality video systems, a QoS resource manager allocates processor capacity budgets to tasks 
that perform audio and video processing. The budgets are periodic, and the budget period 
may be different for each task. The QoS resource manager allocates the budgets for a longer 
interval of time, encompassing many periods. For reasons of cost-effectiveness, the budgets 

1 5 must result in a high average processor utilization, while at the same time maximizing the 
perceived quality of the combined task outputs. In a situation where a stable output quality 
level is required, a budget that allows an anticipated load increase is allocated to a task. In 
this way, whenever such a load increase occurs, it can be handled without delay. Such a task,^ 
say x m? performs, for example, a video processing operation for a main picture image of a 

20 television set. In this case, a stable output quality level means a stable picture quality. A 
second task, say t p , performs, for example, a video processing operation for a picture-in- 
picture image of this television set. Unlike task x m , this task has a less stringent requirement 
for a stable picture quality. Still, to maximize the perceived quality, this task receives any 
budget surplus from task x m whenever available. In this way, task x p may be able to improve 

25 on the quality of the picture-in-picture image whenever task t m does not require its full 

budget. There may be more tasks, performing other processing operations. For example, a 
third task, say x a , may perform an audio processing operation. These tasks may not need a 
budget that allows an anticipated load increase and they may neither benefit from any budget 
surplus from some other task. 

30 The scheduling of the tasks can be done as described in the main steps below. 

Process step 102 is an initialization step during which the tasks to be scheduled are given 
their periodic budgets and are made known to a budget scheduler. The budget scheduler is 
part of the QoS resource manager and controls the actual scheduling operations, based on the 
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periodic budgets. It is implemented on top of a commercially available real-time operating 
system providing pre-emptive fixed priority-based scheduling. The budget scheduler uses 
priority manipulations to implement budgets. In-budget execution is performed at a high 
priority, and out-of-budget execution is done at a low, background priority p^ For the in- 
5 budget execution, the tasks are scheduled in rate-monotonic priority order, such that a task 
with a smaller budget period gets a higher priority. Priorities of tasks are disjoint for in- 
budget execution. At the background priority pb, a task can potentially receive some slack 
time for execution in the background, competing for this time with any other tasks executing 
at this priority. As part of process step 102, the budget scheduler associates an in-budget 

1 0 priority to each of the tasks to be scheduled, based on the budged period of a task. For 

example, in the case of the tasks T m , x a , and x p introduced above, this may be the priorities pi, 
P2, and p3, respectively, where pi > p2 > p3- Thus, task x m , performing the main picture 
processing operation, has the highest priority pi, task x p , performing the picture-in-picture 
processing operation, has the lowest priority p3, and task x a , performing the audio processing 

1 5 operation has a priority p 2 in between. All of these priorities are higher than the background 
priority p b . 

In process step 104, the budget scheduler enforces the budgets of all tasks. 
This step is entered repeatedly, whenever rescheduling operations are needed. One reason for 
a rescheduling operation may be a task that enters a new, next budget period. This task gets 

20 replenishment of its budget for that period and its priority is raised to its rate-monotonic 
priority. Another reason for a rescheduling operation may be a task that, while executing, 
exhausts its budget. For such a task, the budget scheduler lowers the priority to the 
background priority. Yet another reason for a rescheduling operation may be a task that 
finishes its processing within its budget and now releases the processor. Now the budget 

25 scheduler also lowers the priority of this task to the background priority. Once entered, 

process step 104 may need to perform multiple rescheduling operations, for multiple tasks. 
Next, after all necessary rescheduling operations have been performed the task with the 
highest priority gets selected in process step 106 and is scheduled for processing on the 
processor, 

30 In decision step 108, the budget scheduler detects the need for rescheduling 

operations by means of rescheduling events. A rescheduling event signals that rescheduling 
operations may be required. One kind of rescheduling event relates to a task that finishes its 
processing and releases the processor. Other kinds of rescheduling events relate to budget 
replenishment and budget exhaustion. These budget-related events ensue from earlier 
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rescheduling operations performed as part of process step 104. In the present embodiment, 
these budget-related rescheduling events are realized by means of a low-level timer service 
available from the real-time kernel used. This is not further shown here. 

In decision step 110, the budget scheduler determines whether a budget 

5 surplus can be reallocated. In this step, it checks to see if the task last run has finished its 
processing within the budget, giving rise to a budget surplus, and whether such a budget then 
needs to be reallocated to another task. For example, in the case of the tasks x m and x p 
introduced above, if task x m finishes its processing within its budget, decision block 108 may 
decide to reallocate the remaining budget from task x m to task x p . If a budget surplus can be 

10 reallocated, this reallocation starts with process step 1 12, in which the budget scheduler saves 
the value of the currently remaining budget for the task that is to receive the budget surplus. 
The budget scheduler also saves the priority of the receiving task. In the case of task x p this 
would be priority P3. Next, the actual reallocation occurs in process step 1 14. Here the task 
that is to receive the budget surplus actually gets assigned this budget, together with the 

15 priority of the task that provides the budget surplus. In the case of the tasks x m and x p , here 
the priority of task x p is set to pi, being the priority of task x m . Processing continues with 
process step 104. 

If a budget surplus is not available or reallocation is not needed, decision step 
116 checks if the task last run did so using a budget surplus for which reallocation should 

20 end. A reallocation of a budget surplus to the task last run ends if the budget surplus gets 
exhausted or the task has finished its processing. If indeed the reallocation should end, inv 
process step 118, the budget and priority values earlier saved for this task in process step 1 12 
are now restored. Thus, in the case of task x p> the priority is restored to priority p 3 here. 
Processing continues with process step 104. This is also the case if in decision step 1 16 the 

25 task last run did not do so using a budget surplus for which reallocation should end. 

The order of steps in the present embodiment is not mandatory. A person 
skilled in the art may change the order of steps or performs steps concurrently, for example 
by using threading models, multi-processor systems or multiple processes, without departing 
from the concept as intended by the current invention. 

30 In the present embodiment, the reallocation is performed for a single budget 

surplus from one task to another task. Li other embodiments, the reallocation could be 
performed for multiple budget surpluses originating from multiple tasks and being 
reallocated to multiple tasks. For example, a budget surplus from one task could be 
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reallocated to multiple other tasks, or one task could receive budget surpluses from multiple 
other tasks. Also embodiments in which any unused parts of budget surpluses are once more 
reallocated are conceivable. Those skilled in the art will recognize such possibilities. 

In the present embodiment, tasks are described as singular entities, with a 
5 budget, a budget period, and a priority. In other embodiments, such a task could actually 
represent a cluster of tasks, together sharing a single budget and a single budget period, but 
occupying a band of priorities so that the individual tasks within the cluster can be 
prioritized. Those skilled in the art will recognize such possibilities. 

In the present embodiment, the budget scheduler uses fixed priority scheduling 
10 as the basic scheduling algorithm. In other embodiments, dynamic priority scheduling or 
mixed priority scheduling could be used. Those skilled in the art will recognize such 
possibilities. 

Fig. 2 and Fig. 3 together illustrate the reallocation of a budget surplus. Fig. 2 
shows a task interaction diagram and Fig. 3 a related priority level diagram. Basically, a task 

15 interaction diagram shows the execution of tasks over time. The tasks concerned are 

indicated on the vertical axis, and time runs on the horizontal axis. For each task, the diagram 
contains a timeline with indications for the status or status changes of that task. Also 
interactions between tasks can be shown. For the normal case, without budget surplus 
reallocations, indications include: budget enabling (also called replenishment), and indicated 

20 by a solid up-arrow, budget disabling, indicated by a solid down-arrow, and executing, that is 
consuming budget, indicated by a solid or shaded rectangle. To specifically indicate budget 
surplus reallocations, the following indications are also used: surplus enabling, indicated by 
an open up-arrow, surplus disabling, indicated by an open down-arrow, and the budget 
remainder being reallocated, indicated by a dotted rectangle. The diagram of Fig. 2 shows the 

25 execution of three tasks, x m , x a , and x p . These tasks have budgets of 5, 3, and 1 units of time, 
and budget periods of 10, 1 1, and 12 units of time respectively. Furthermore, task x p is to 
receive any budget surplus from task x m . 

Scheduling is done with a pre-emptive fixed priority-based scheduling 
algorithm and a rate-monotonic priority assignment based on the budget periods. For the 

30 tasks x m , x a , and x p , this results in the priorities p l? p 2 , and p 3 for in-budget execution, where 
pi > p 2 > p 3 . These priorities are shown on the vertical axis of the priority level diagram of 
Fig. 3 . By means of a different line for each task, this diagram shows how the priority of each 
task changes over time. The lines 302, 304, and 306 represent the priorities of tasks x m , x a , 
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and x p respectively. The top of Fig. 3 shows which one of the tasks x m , x a , and t p has the 
highest priority at any time, and is consequently executing at that time. For all of the three 
tasks, out-of-budget execution is possible at a low, background priority p b , also shown in 
Fig. 3. 

5 At time t = 0, all of the three tasks enter a new budget period and receive a 

replenishment of their budget, indicated by solid up-arrows 202, 204, and 206. As a result of 
this, the tasks x m , x a , and t p , get assigned their in-budget priorities pi, p 2 , and p 3 , respectively. 
Because x m has the highest priority, pi, it is scheduled for execution on the processor. 

At time t = 3, task x m finishes processing for this budget period, after 

10 consuming only 3 of the 5 available budget units, indicated by rectangle 208. As a result, its 
budget is disabled, indicated by solid down-arrow 210, and its priority lowered from priority 
pi to the background priority p^ This leaves a budget remainder of 2 units, indicated by 
rectangle 212. Since a budget remainder of task x m is to be reallocated to task x p , reallocation 
is enabled for task x p at time t = 3, indicated by open up-arrow 214. Thus, task x p receives a 

15 budget surplus of 2 units. Together with this budget, surplus task x p receives the in-budget 
priority pi of task x m . Still at time t = 3, this results in a priority raise for task x p , from priority 
p 3 to priority pi, as shown in Fig. 3. Now task x p has the highest priority, pi, and starts 
executing, consuming the budget surplus, indicated by rectangle 216. 

At time t = 5, task x p exhausts the budget surplus, after consuming 2 budget 

20 units, indicated by rectangle 216. As a result, the reallocation is disabled, indicated by open 
down-arrow 218. Because of this disabling, task x p reverts to the budget and priority it had 
before the reallocation took place. Thus, at time t = 5, the priority of task x p is lowered from 
priority pi back to priority p3, as shown in Fig. 3. Now, task x p is also no longer the task with 
the highest priority, as this is now task x a with priority p 2 . Consequently, task x a gets 

25 scheduled and starts consuming its budget, indicated by rectangle 220. 

At time t = 8, when task x a exhausts its budget of 3 units, indicated by 
rectangle 220, its budget is disabled, indicated by solid down-arrow 222, and its priority 
lowered from priority p2 to priority pb. Now, task x p is once more the task with the highest 
priority. Thus, at time t = 8 task x p is scheduled again, and for the first time starts consuming 

30 its own budget, indicated by rectangle 224. 

At time t = 9, when task x p exhausts its budget of 1 unit, indicated by rectangle 
224, its budget is disabled, indicated by solid down-arrow 226, and its priority lowered from 
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priority pi to priority p b . Now, all of the three tasks are scheduled at the background priority 
Pb, possibly consuming some of the slack time, indicated by rectangle 228. 

At time t = 10, task x m enters a new budget period and receives a 
replenishment of its budget, indicated by solid up-arrow 230. As a result of this, task x m gets 
5 assigned its in-budget priority pi again, and starts executing with a new budget. Later, at time 
t = 1 1 and time t = 12, the new budget periods of tasks x a and t p start, with the corresponding 
replenishments, indicated by solid up-arrow 232 and 234. 

Fig. 4 illustrates, in a schematic way, the most important parts of an 
embodiment of the system according to the invention. The system 400 comprises a first 

10 allocation unit 402, programmed to allocate a first budget to a first task. A second allocation 
unit 404 is programmed to allocate a second budget to a second task. There may be more 
allocation units, programmed to allocate budgets to other tasks. A scheduling unit 406 
enforces the budgets of all tasks. Part of the scheduling unit 406 is a detection unit 408, 
programmed to detect that the first task uses up only part of the first budget. If this is the 

15 case, a budget surplus memory 410 contains the remaining part of the first budget. A 

reallocation unit 412 is used to reallocate the budget surplus to the second task. Part of the 
reallocation unit 412 is a third allocation unit 414, programmed to allocate the budget surplus 
held in budget surplus memory 410 to the second task, together with scheduling 
characteristics of the first task. This system can be realized in software intended to be 

20 operated as an application by a computer or any other standard architecture able to operate 
software. The system can be used to operate a digital television set 416. 

Fig. 5 illustrates, in a schematic way, the most important parts of a television 
set 500 that comprises an embodiment of the system according to the invention. Here an 
antenna 502 receives a television signal. The antenna may also be, for example, a satellite 

25 dish, cable or any other device able to receive a television signal. A receiver 504 receives the 
signal. Besides the receiver 504, the television set 500 comprises a programmable component 
506, for example a programmable integrated circuit. This programmable component 506 
comprises a system according to the invention 508 such as the system described with 
reference to Fig. 4. A television screen 510 shows images that are received by the receiver 

30 504 and are processed by the programmable component 506, the system according to the 
invention 508 and other parts that are normally comprised in a television set, but are not 
shown here. 

Fig. 6 illustrates, in a schematic way, the most important parts of a set-top box 
600 that comprises an embodiment of the system according to the invention. Here an antenna 
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602 receives a television signal. The antenna may also be, for example, a satellite dish, cable 
or any other device able to receive a television signal. A set-top box 600 receives the signal. 
Besides the normal parts that are comprised in a set-top box, but are not shown here, the set- 
top box 600 comprises a system according to the invention 604 such as the system described 
5 with reference to Fig. 4. The television set 606 can show the output signal generated by the 
set-top box 602 together with the system according to the invention 604 from a received 
signal. 

The invention can be summarized as follows. 

Media processing in software can be used for consumer terminals like digital 
10 television sets or set-top boxes. For reasons of cost-effectiveness, the average processor 
utilization must be high. This is mostly achieved by allocating below worst-case processor 
budgets to tasks performing media processing operations. Only if a stable output quality is a 
primary requirement, a task gets allocated a worst-case processor budget. To gain back on the 
cost-effectiveness in such a situation, a method and a system are provided to reallocate an 
15 unused part of a budget (212) from a first task (x m ) with a worst-case budget to a second task 
(t p ) with a below worst-case budget. The second task (t p ) may then use the resulting budget 
surplus (216) to improve the quality of its output. The method and system operate at a very 
low level, in the scheduling of the tasks performing the media processing. What effectively 
happens is that the second task (x p ) gets executed in the place of the first task (x m ), as if it 
20 were the first task (x m ), with scheduling characteristics such as period and priority of the first 
task (x m ). 
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CLAIMS: 



13 



L A method of scheduling a first task and a second task, the method comprising 

the following steps: 

a first step of allocating a first budget to the first task, 
a second step of allocating a second budget to the second task, 
5 a third step of determining that the first task uses up only part of the first 

budget, with the remaining part of the first budget giving rise to a budget surplus, 

a fourth step of reallocating the budget surplus to the second task, in addition 

to the second budget, 

characterized in that the fourth step comprises a sub-step of: 
10 allocating the budget surplus to the second task together with scheduling 

characteristics of the first task. 

2. A method according to claim 1 , wherein a fixed priority based scheduling 
algorithm is applied and said scheduling characteristics correspond to a period and a priority 

15 of the first task. 

3. A method according to claim 1, wherein a deadline driven based scheduling 
algorithm is applied and said scheduling characteristics correspond to a period and a deadline 
of the first task. 

20 

4. A system (400) for scheduling a first task and a second task, the system 
comprising: 

first allocation means (402) conceived to allocate a first budget to the first 

task, 

25 second allocation means (404) conceived to allocate a second budget to the 

second task, 

determination means (408) conceived to determine that the first task uses up 
only part of the first budget, with the remaining part of the first budget giving rise to a budget 
surplus, 
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reallocation means (412) conceived to reallocate the budget surplus to the 
second task, in addition to the second budget, 

characterized in that the reallocation means comprises: 
third allocation means (414) conceived to allocate the budget surplus to the 
5 second task together with scheduling characteristics of the first task. 

5. A television set (500) comprising a system according to claim 4. 

6. A set-top box (600) comprising a system according to claim 4. 
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